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Feedback  on  a  360  degree  Leader  AZIMUTH  Check  assessment  conducted  at  Fort 
Clayton,  Panama 

Introduction 

In  September  of  1998,  the  Quality  Improvement  Office  of  the  Theater  Support  Brigade  at 
Fort  Clayton,  Panama  first  contacted  the  U.S.  Army  Research  Institute  at  Fort  Leavenworth,  KS 
requesting  information  pertaining  to  the  Leader  Azimuth  Check  instrument.  This  instrument  is 
based  on  Army  leadership  doctrine  and  is  designed  to  assess  leadership  behaviors  from  the 
perspective  of  self,  subordinates,  peers  and  superiors  (See  Appendix  A).  The  Quality 
Improvement  Office  under  Colonel  Richard  Thomas  also  requested  assistance  in  the  processing 
and  interpretation  of  360  degree  feedback  assessment  for  their  military  and  civilian  employees. 
The  U.S.  Army  Research  Institute  responded  by  agreeing  to  process  data  from  the  Leader 
Azimuth  Check  instrument  and  to  provide  the  interpretation  and  counseling  of  the  feedback  to 
the  leaders  who  had  been  selected  for  assessment. 

ARI  mailed  the  surveys  to  Fort  Clayton  in  October  1998.  The  Quality  Improvement 
Office  was  responsible  for  determining  the  subordinate,  peer,  and  superior  raters  for  each 
targeted  leader  and  for  distributing  the  surveys.  These  individuals  were  given  oral  and  written 
instructions  for  completing  the  multi-rater  assessment.  Subsequent  inquiries  indicated  that  some 
bilingual  civilian  subordinate  raters  had  difficulty  with  the  instructions  and  the  language  used  in 
the  survey  (particularly  the  reverse  coded  items,  i.e.,  the  undesirable  behaviors).  It  should  also  be 
noted  that  surveys  were  completed  in  the  context  of  a  100%  drawdown,  with  most  participants 
expecting  to  be  working  somewhere  else  by  July  of  1999.  Surveys  were  completed  by  November 
10th  and  mailed  back  to  ARI  for  analysis. 

Thirty  seven  commissioned  and  non-commissioned  military  officers  and  approximately 
40  civilians  completed  the  Leader  Azimuth  Check.  Generally  one  superior,  at  least  2  peers  and  at 
least  2  subordinates  (in  some  cases  as  many  as  seven  peers  and  six  subordinates)  also  completed 
the  Azimuth  for  the  targeted  leader.  This  feedback  was  processed  and  interpreted  in  December 
1998.  Not  all  leaders  were  available  for  feedback  interpretation  (due  to  temporary  duty  travel, 
or  recent  change  in  duty  station). 
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Finally,  the  Quality  Improvement  Office  distributed  a  follow-up  survey  intended  to  assess 
perceptions  about  the  multi-rater  process.  These  were  completed  anonymously.  The  duration  of 
time  between  feedback  interpretation  of  Azimuth  results  and  the  follow-up  survey  varied.  The 
follow-up  was  designed  to  assess  1)  perceptions  of  trust  and  fairness  in  the  multi -rater  process,  2) 
understanding  of  the  multi-rater  process,  3)  beliefs  about  the  accuracy  and  appropriateness  of  the 
categorical  source  of  feedback,  and  4)  self-efficacy  and  intentions  for  change  in  leadership 
behaviors.  (See  Appendix  B).  Due  to  holiday  breaks  and  TDYs,  the  follow-up  surveys  were 
collected  at  varying  times  by  the  Quality  Improvement  Office.  In  January  1999,  a  total  of  54 
completed  follow-up  surveys  were  received  and  analyzed  by  ART 


Targeted  Leaders  Rank  and  Grade _ Count 


Commissioned  Officers 

Colonel 

1 

LTC 

7 

Major 

9 

Captain 

7 

Non-commissioned  Officers 

Chief  Warrant  Officer  4 

2 

Command  Sergeant  Major 

3 

First  Sergeant 

8 

**Civilian  Leaders  range  in 
grade  level  from  GS9-GS14 

40 

Interesting  findings  with  Azimuth  follow-up  survey 

Subordinates  were  overwhelmingly  viewed  as  the  most  valuable  source  of  feedback. 

Responses  in  the  follow-up  survey  indicate  that  subordinates  feedback  was  the  most 
valuable  source  of  information.  A  higher  percentage  of  targeted  leaders  (58%)  viewed  their 
subordinates  as  the  most  valuable  source  of  information  as  compared  to  the  10%  who  believed 
superiors  and  6%  who  believed  peers  were  the  most  valuable  source  of  information. 

Subordinates  were  viewed  as  an  appropriate  source  for  information  concerning  leadership 
skills  by  93%  of  the  targeted  leaders.  Superiors  were  also  viewed  as  appropriate  source  of 
information  by  92%,  however  peer  feedback  was  only  deemed  appropriate  by  63%  of 
respondents. 
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In  terms  of  the  accuracy  of  assessment,  82%  believed  their  subordinates’  feedback  was  an 
accurate  reflection  of  their  leadership.  Eighty  three  percent  also  believed  that  their  superiors 
feedback  was  accurate  whereas,  only  65%  believed  peer  feedback  was  accurate. 

These  data  can  be  interpreted  in  at  least  two  ways.  On  the  one  hand,  a  number  of  people 
have  questioned  the  appropriateness  of  a  multi-rater  assessment  process  within  the  military.  This 
argument  is  that  encouraging  subordinates  to  assess  their  superiors  may  be  detrimental  to 
discipline  and  order.  On  the  other  hand,  results  suggest  that  at  least  within  this  organization, 
subordinate  feedback  is  not  a  problem.  However,  we  must  remember  that  over  half  of  the 
participants  (and  an  unknown  proportion  of  the  follow-up  respondents)  were  civilians. 

A  second  interpretation  drawn  from  these  data  is  that  positive  responses  to  subordinate 
feedback  (and  the  somewhat  indifferent  reception  of  feedback  from  other  sources)  is  an  accurate 
reflection  of  the  structure  of  this  organizational  unit.  Virtually  all  targeted  leaders  received 
assessments  from  one  superior.  In  the  feedback  sessions,  targeted  leaders  showed  the  least 
interest  in  superior’s  feedback;  many  said  “no  surprises  there.”  Additionally,  there  were 
indications  of  inflated  (non-informative)  ratings  from  superiors  compared  to  other  sources. 
Perhaps  targeted  leaders  are  accustomed  to  mostly  positive  ratings  from  superiors,  as  anything 
else  is  unusual  given  the  evaluative  setting  in  which  ratings  are  usually  received.  Targeted 
leaders  also  received  input  from  at  least  two  peers,  however,  many  commented  that  their  peers 
could  not  be  and  were  not  aware  of  their  daily  routines  and  behaviors  due  to  the  diversity  in 
duties  and  locations.  Thus,  the  input  from  subordinates,  which  is  not  usually  readily  available 
was  received  with  the  most  interest. 

Motivation  to  change  leadership  behaviors 

Between  76%  and  79%  of  respondents  reported  that  participating  in  the  360  assessment 
has  motivated  them  to  re-examine/change  their  leadership  behavior  (depending  on  how  the 
question  was  asked).  Eighty-three  percent  report  that  they  will  use  their  feedback  to  monitor  and 
develop  their  leadership.  Most  leaders  (83%)  felt  that  there  were  resources  readily  available  to 
assist  them  in  self-development.  Eighty-  three  percent  also  felt  capable  of  implementing  the 
changes  which  the  feedback  indicated  were  necessary,  and  83%  reported  that  their  current 
working  climate  allowed  for  self  development. 

Motivation  to  change  was  best  predicted  (using  regression  analyses)  by  the  extent  to 
which  leaders  believed  the  feedback  they  received  was  new  information.  Similarly,  those  who 
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deemed  feedback  to  be  valuable  were  more  likely  to  be  motivated  to  change.  A  third  good 
predictor  of  motivation  to  change  came  from  beliefs  in  one’s  own  ability  to  implement  change 
(self-efficacy).  Finally,  96%  of  respondents  reported  understanding  how  the  feedback  could  be 
used  for  further  self-development. 

Results  concerning  acceptance  of  360 

During  feedback  sessions  most  leaders  seemed  receptive  and  motivated  to  learn  from  the 
feedback.  Analysis  of  the  follow-up  survey  indicated  that  satisfaction  with  the  multirater  process 
was  best  predicted  by  perceptions  of  fairness,  perceptions  of  accuracy  in  feedback  and  an 
understanding  of  methods  used  to  collect  and  report  feedback.  As  expected,  there  were  positive 
correlations  between  perceptions  of  fairness  and  satisfaction  and  between  perceptions  that 
feedback  was  accurate  and  satisfaction.  However,  the  direction  of  the  relation  between 
understanding  and  satisfaction  was  rather  counterintuitive.  We  found  that  higher  reported 
understanding  of  the  multi-rater  process  was  associated  with  less  satisfaction  with  the  360 
process.  The  particular  process  or  aspect  of  assessment  that  led  to  the  lower  satisfaction  for  these 
individuals  is  unknown.  Nonetheless,  most  respondents  understood  how  a  multi-rater  system 
works  and  believed  it  to  be  fair. 

•  76%  agreed  that  360’s  are  a  fair  way  to  assess  leadership 

•  78%  satisfied  with  360  process 

•  82%  felt  the  concept  of  multi-rater  assessments  have  potential  for  Army  use 

•  91%  trusted  the  confidentiality  of  the  process 

•  94%  understood  the  methods  for  gathering  data  and  figuring  averages 

•  96%  reported  adequate  knowledge  of  the  360  process,  as  a  whole 

Due  to  time  constraints,  we  were  not  able  to  assist  targeted  leaders  in  developing  actions 
plans,  however  most  research  indicates  the  importance  of  setting  goals  and  following  through  in 
this  manner.  Leaders  were  advised  to  follow-up  by  reviewing  their  feedback,  communicating 
with  those  who  had  provided  feedback,  and  developing  specific  plans  to  improve  identified 
developmental  needs. 

Ideally,  a  follow-up  several  months  after  the  initial  feedback  is  recommended.  However, 
since  leaders  at  Fort  Clayton  are  also  dealing  with  draw-down  issues,  this  follow-up  was  not  a 
viable  option  for  many.  Nevertheless,  at  least  two  officers  requested  materials  for  follow-up. 
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Implications  and  Recommendations 

The  Theater  Support  Brigade  took  advantage  of  a  tool  that  has  the  potential  to  initiate  and 
optimize  self-development.  To  leverage  this  self-development  it  is  recommended  that  materials 
(perhaps  a  reading  list)  be  made  available  to  assist  targeted  leaders  in  achieving  their 
developmental  goals.  Additionally,  the  chain  of  command  should  develop  and  monitor  specific 
action  plans.  It  is  also  strongly  recommended  that  more  information  regarding  the  purpose  and 
process  of  the  multi-rater  assessment  be  provided  up  front  to  all  who  participate  in  the  process. 
Finally,  all  efforts  to  follow  up  are  encouraged  and  assessments  of  the  effectiveness  of  such  a 
process  should  be  conducted. 
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Appendix  A 


PURPOSE:  This  questionnaire  has  been  designed  by  the  U.S.  Army  Research  Institute  and  the  Center  for  Army 
Leadership  to  obtain  information  in  support  of  leader  self-development.  The  items  in  the  questionnaire  and  the 
feedback  based  on  the  items  are  consistent  with  current  and  emerging  Army  Leadership  Doctrine. 

CONFIDENTIALITY:  The  individual  ratings  and  the  overall  results  are  provided  to  the  person  who  is  being  rated; 
the  information  is  not  provided  to  anyone  in  the  officer's  rating  chain.  If  you  are  providing  ratings  on  someone 
else,  your  input  is  anonymous. 


PT59-96 

3/14/97 
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Leader  AZIMUTH  check 


Introduction 

The  Army  places  special  emphasis  on  self-development  to  enhance  the  leadership  skills  of  military  and  civilian 
leaders.  As  part  of  self-development,  it  is  important  for  individuals  to  become  aware  of  their  own  strengths  and 
weaknesses.  You  are  asked  to  provide  input  on  the  strengths  and  weaknesses  of  the  designated  officer.  AZIMUTH 
provides  each  person  with  feedback  based  on  a  comparison  of  their  own  self-perceptions  and  others'  perceptions  of 
them.  This  information  is  needed  from  you  in  order  to  provide  complete  and  high  quality  information  for  the  rated 
individuals.  YOUR  VOLUNTARY  PARTICIPATION  IS  NEEDED.  You  are  encouraged  to  answer  all  questions,  but 
failure  to  respond  to  any  item  will  not  result  in  any  penalty. 


The  identification  numbers  and  names  on  the  AZIMUTH  answer  sheets  are  provided  to  identify  the 
person  being  rated.  When  you  are  rating  someone  else  your  rating  is  ANONYMOUS;  no  record  is  kept  of  who 
rates  whom.  However,  if  you  do  not  respond  to  all  the  questions,  then  the  person  being  assessed  will  receive 
incomplete  feedback.  If  you  are  doing  a  self-assessment,  rating  yourself,  you  need  to  be  aware  that  the 
self-assessment  cannot  be  anonymous;  we  need  to  be  able  to  identify  you  in  order  to  provide  you  feedback.  Only 
persons  involved  in  collecting  or  preparing  the  information  for  analysis  will  have  access  to  completed  AZIMUTH  forms. 
Any  reports  of  these  data  will  contain  only  group  statistics. 


Instructions 

lf_you  are  using  this  form  for  self-assessment:  1)  Be  sure  to  read  and  sign  the  Privacy  Act  Statement  before 
proceeding.  2)  Fill  in  your  own  name  and  ID  number  on  all  mark-sense  response  forms  to  be  completed  by  yourself 
and  others.  3)  Complete  one  self  form  by  marking  the  bubbles  which  best  indicate  how  well  each  item  describes  you. 

If  you  are  rating,  someone  else:  The  person  being  rated  should  have  already  filled  in  their  name  and  ID  number  section. 
Please:  1)  Skip  the  Privacy  Act  Statement  section.  2)  Fill  in  a  bubble  at  the  top  of  page  3  to  indicate  whether  the  person 
being  rated  is  your  peer,  subordinate  or  superior.  3)  Mark  the  bubbles  which  best  indicate  how  well  each  item 
describes  the  person  you  are  rating. 


PRIVACY  ACT  STATEMENT; 

Public  Law  93-573,  called  the  Privacy  Act  of  1974,  requires  that  you  be  informed  of  the  purpose  and  uses  to  be 
made  of  any  information  collected. 

The  Department  of  the  Army  may  collect  the  information  requested  in  this  questionnaire  under  the  authority  of 
10  United  States  Code  137.  Providing  information  in  this  questionnaire  is  voluntary.  Failure  to  respond  to  any  particular 
questions  will  not  result  in  any  penalty.  However,  if  you  are  providing  an  assessment  of  yourself,  then  failure  to  provide 
your  ID  number  will  prevent  you  from  receiving  feedback  for  your  leadership  self-development. 

The  primary  use  of  the  information  collected  will  be  to  provide  the  person  being  rated  with  feedback  for  his/her 
leadership  self-development.  The  aggregate  data  will  also  be  used  by  the  U.  S.  Army  Research  Institute  for  research 
and  development  purposes.  Your  responses  will  be  held  in  strict  confidence.  No  responses  or  summaries,  whole  or  in 
part,  will  become  a  part  of  any  individual's  personnel  file.  This  information  will  not  be  used  by  anyone  for  an 
evaluation  of  the  person  being  assessed  -  it  will  be  used  to  provide  him/her  with  feedback  for 
self-development. 


( If  you  are  providing  an  assessment  of  someone  else,  then  please  DO  NOT  enter  your  name  or  signature.) 

PRINT  your  name  here: _ _ _ Date: _ 

I  authorize  use  of  this  information  as  stated  above:  _ _ 

(Sign  Your  Name  Above) 
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Name  of  person  being  rated: 


MARK  THIS  ITEM  FIRST 
The  Person  Being  Rated 


is  my: 

O 

Self 

o 

Peer 

o 

Subordinate 

o 

Superior 

Identification  Number 


®®®®®(3D(3D®(iD 
CD  CD  CD  CD  CD  CD  CD  CD  CD 
(DGDC 2)  ®  ©  ®  ®  ®  ® 
®®®®®®®®® 
CD(D(D(DCDCD®CDCD 
©©©©©©CD©© 
(D  CD  CD  CD  CD  CD  CD  CD  ^6) 
(DCDCDCDCDCDCDCDCD 
®®®®©®®®® 
®®®®®®®®® 


I  MARKING  INSTRUCTIONS 


*  Use  a  No.  2  pencil  only. 

► Do  not  use  ink,  ballpoint,  or  felt  tip  pens. 

>  Make  solid  marks  that  fill  the  response  completely. 

>  Erase  cleanly  any  marks  you  wish  to  change. 

Make  no  stray  marks  on  this  form. 

CORRECT:  •  INCORRECT: 


[  In  compansoriwitE^offters  l  have  known  well*  !  think  the 


Have  not  observed 
Extremely  Poor  Description 
Very  Poor  Description 
Slightly  Poor  Description 
Slightly  Good  Description 
Very  Good  Description 
Extremely  Good  Description 


Communicating 

1.  Does  not  provide  clear  direction. 

2.  Explains  own  ideas  so  that  they  are  easily  understood. 

3.  Keeps  others  well  informed. 

4.  Listens  well. 

5.  Tells  it  like  it  is. 

6.  Writes  poorly. 

Decision  Making 

7.  Delays  decisions  unnecessarily. 

8.  Generates  innovative  solutions  to  unique  problems. 

9.  Ignores  information  that  conflicts  with  own  initial  assumptions. 

10.  Makes  sound  decisions  in  a  timely  manner. 

11.  Wiiling  to  revisit  a  decision  when  new  information  calls  for  it. 

Motivating 


ooojooojo 

ooojooojo 

O  O  OiO  O  OjO 

O  O  ojo  C  0:0 
ooojooojo 

O  O  OIO  C  ob 


OOOk 

O  O  Ok 

O  O  oli 

o  O  O' 


:■  0:0 


12.  Creates  a  supportive  work  environment. 

13.  Disciplines  in  a  firm,  fair,  and  consistent  manner. 

14.  Inspires  people  to  do  their  best. 

15.  Often  acknowledges  good  performance  of  others. 

16.  Sets  clear  performance  expectations. 


ooooc oo 

OQOC C CO 
o  O  OO  C  GO 
o  o  oo  C  CO 
O  O  OIO  Q  OO 


Developing 

17.  Does  not  encourage  professional  growth. 

18.  Is  an  effective  teacher. 

19.  Often  uses  counseling  to  provide  performance  feedback. 

20.  Provides  opportunities  to  learn. 

21 .  Seldom  delegates  authority. 


O  O  0:0  C  CO 
O  O  CO  o  oo 
o  o  oic  c  oo 
oo  ojo  coo 
o  o  oio  o  o  o 


Building 

22.  Actively  participates  in  organizational/unit  activities. 

23.  Encourages  cooperation  among  team  members. 

24.  Encourages  organization/unit  activities. 

,  25.  Focuses  the  organization/unit  on  mission  accomplishment. 

26.  Treats  others  as  valuable  team  members. 


000(0  0 o;c 
o  o  oio  o  oo 
oo  ojo  oco 
o  o  ojo  c  oo 
o  o  ojo  o  oo 


Learning 

27.  Becomes  defensive  when  given  critical  feedback. 

28.  Encourages  open  discussion  to  improve  the  organization/unit. 

29.  Helps  organization/unit  adapt  to  changing  circumstances. 

30.  Seems  to  be  realistic  about  own  personal  limitations. 

31.  Willingly  accepts  new  challenges. 

Planning  and  Organizing 

32.  Anticipates  how  different  plans  will  look  when  executed. 

33.  Develops  effective  plans  to  achieve  organizational  goals. 

34.  Leaves  key  events  to  chance. 

35.  Sets  clear  priorities. 

36.  Unwilling  to  modify  original  plan  when  circumstances  change. 


o  o  oio  O  GO 
ooojo'oo|o 
O  O  GO  O  oio 
ooojoooio 
O  O  oio  o  oio 


ooo 

ooo 

ooo 

ooo 

ooo 


O  C  oio 

OOOG 

o  c  oio 
o  o  ojo 
o  o  ojo 
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^  ;  Have  Not  Observed 

'  Extremely  Poor  Description  . 
Very  Poor  Description 
Slightly  Poor  Description 
Slightly  Good  Description 
Very  Good  Description 
Extremely  Good  Description 


Executing 


Assessing 


37.  Completes  assigned  missions  to  standard. 

38.  Does  not  meet  mission  timelines. 

39.  Does  whatever  is  necessary  (within  ethical  limits)  to  complete  the  mission. 

40.  Monitors  execution  of  plans  to  identify  problems. 

41 .  Refines  plans  to  exploit  unforeseen  opportunities. 

I 

42.  Accurately  assesses  the  organization/unit's  strengths. 

43.  Accurately  assesses  the  organization/unifs  weaknesses. 

44.  Makes  organizational  changes  for  no  apparent  reason. 

45.  Rarely  conducts  after-action  reviews. 

46.  Takes  time  to  find  out  what  subordinates  are  doing. 


Respect 


47.  Actively  supports  equal  opportunity  for  all  persons. 

48.  Creates  a  climate  of  fairness  in  the  organization/unit. 

49.  Excludes  some  from  team  activities. 

50.  Treats  others  with  respect. 

Selfless  Service 

51 .  Claims  credit  for  others'  work. 

52.  Considers  the  needs  of  own  and  others’  family  members. 

53.  Places  the  welfare  of  the  organization  before  own  personal  gain. 

54.  Takes  advantage  of  others  to  advance  own  career. 

55.  Takes  privileges  not  allowed  others. 

Integrity 

56.  Behaves  with  questionable  ethics. 

57.  Demonstrates  moral  courage  (does  what  is  right). 

58.  Is  not  sensitive  to  the  ethical  impacts  of  decisions. 

59.  Is  trustworthy. 

60.  Sets  the  proper  ethical  example  for  others. 

Emotional  Stability 

61 .  Does  not  display  extreme  anger. 

62.  Exhibits  wide  mood  swings. 

63.  Maintains  calm  disposition  under  stress. 

64.  Possesses  an  even  temperament. 

65.  Seems  to  behave  unpredictably. 


ooooooo 

ooooooo 

ooooooo 

ooooooo 

ooooooo 

ooooooo 

ooooooo 

ooooooo 

ooooooo 

ooooooo 

ooooooo 

ooooooo 

ooooooo 

ooooooo 

ooooooo 

ooooooo 

oooioooio 

OOOQOOb 

oooooop 

I 

O  O  CIO  o  o|o 
ooco  o  ojo 
oooioooio 
oooooojo 
o  o  o  o  c^  oio 

i 

o  o  o  o  o  oio 
ooooooio 
ooooooio 
oooooojo 
oooooojo 


66.  Demonstrates  appropriate  soldier  skills.  ° 

67.  Is  a  clear  thinker.  Q 

68.  Is  effective  on  the  job.  ° 

69.  Maintains  effective  interpersonal  relations  with  others.  O 

70.  Physically  fit  for  the  job.  ° 

71.  This  person  is  a  good  leader  ° 

72.  This  person  is  someone  I  would  follow  into  combat.  O 

73.  The  questions  contained  in  the  AZIMUTH  were  clear  and  understandable. 

O  Strongly  O  Disagree  O  Slightly  O  Slightly  O  Agree 

Disagree  Disagree  Agree 

74.  The  questions  contained  in  the  AZIMUTH  measure  elements  critical  to  excellence  in  leadership. 

O  Strongly  O  Disagree  O  Slightly  O  Slightly  c  Agree 

Disagree  Disagree  Agree 

75.  I  am  comfortable  with  the  confidentiality  of  my  answers  using  this  procedure. 

O  Strongly  O  Disagree  O  Slightly  O  Slightly  O  Agree 

Disagree  _  Disagree  Agree 


OOOOOOO 

oooooojo 

ooooooo 

ooooooo 

ooooooo 

ooooooo 

ooooooo 


goooo 


IOOOOOOOOO 


O  Strongly 
Agree 

O  Strongly 
Agree 

O  Strongly 
Agree 
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MARKING  INSTRUCTIONS 


The  Leader  AZIMUTH  Check 
Follow-up  Survey 


•  Use  a  No.  2  pencil  only. 

•  Do  not  use  ink,  ballpoint,  or  felt  tip  pens. 

•  Make  solid  marks  that  fill  the  response 
completely. 

•  Erase  cleanly  any  marks  you  wish  to  change. 

CORRECT:  •  INCORRECT:  y  X  •  • 


The  purpose  of  this  questionnaire  is  to  obtain  the  participants'  assessment  of 
the  multi-rater  assessment  process.  Your  responses  to  this  survey  are 
anonymous.  Your  responses  are  an  important  source  of  feedback  for  the  Army 
360  Assessment  Initiative.  Please  rate  the  extent  to  which  you  agree  or 
disagree  with  the  following  statements  using  the  scale  given  at  the  right. 


Strongly  Disagree 


Disagree 


Agree 


Strongly  Agree 


1 .  The  multi-rater  feedback  process  is  a  fair  way  to  assess  my  leadership  abilities. 

2. 1  am  satisfied  with  the  multi-rater  feedback  process. 

3. 1  trust  the  confidentiality  of  the  multi-rater  feedback  process. 

4.  I  believe  the  items  in  the  Leader  AZIMUTH  Check  addressed  skills  relevant  to  my  job. 

5. 1  believe  that  the  feedback  I  received  from  my  subordinates  is  accurate. 

6. 1  believe  that  the  feedback  I  received  from  my  peers  is  accurate. 

7. 1  believe  that  the  feedback  I  received  from  my  superiors  is  accurate. 

8. 1  believe  that  my  subordinates  are  an  appropriate  source  of  information  concerning  my 

leadership  abilities. 

9. 1  believe  that  my  peers  are  an  appropriate  source  of  information  concerning  my 
leadership  abilities. 

10.  I  believe  that  my  superiors  are  an  appropriate  source  of  information  concerning  my 
leadership  abilities. 


11.  Participation  in  this  feedback  process  has  motivated  me  to  re-examine  my  leadership  skills. 

12. 1  intend  to  use  the  feedback  I  received  to  monitor  and  develop  any  behaviors  identified 
as  developmental  areas. 

13.  I  believe  that  there  are  resources  readily  available  to  me  to  improve  my  leader  skills. 

14. 1  believe  that  I  can  implement  the  changes  which  my  feedback  indicates  are 
necessary  for  becoming  a  better  leader. 

15. 1  believe  that  my  working  climate  allows  for  the  self-development  of  leadership 
behaviors. 

’  16.  I  have  an  adequate  knowledge  and  understanding  of  the  mult-rater  feedback  process. 

17. 1  understand  how  multi-rater  feedback  can  be  used  for  self-development. 

18. 1  understand  the  methods  used  for  gathering  data  and  determining  the  scores  in  my  feedback. 


19. 1  feel . about  the  multi-rater  feedback  I  received  .  (Please  mark  all  that  apply.) 

Good  Angry  Pleasantly  Surprised  Other 

Bad  Satisfied  Apprehensive 


Comments: 
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Please  continue  responding  to  the  questions  by  marking  the  oval  next  to  the  response  that  most 
closely  approximates  your  opinion. 


20.  The  360  report  provided  an  accurate  assessment  of  my  leadership: 

Strongly  Agree 

Agree 

Disagree 

Strongly  Disagree 

21 .  The  360  Feedback  Interpretation  Booklet  was  : 

Very  helpful  -  greatly  contributed  to  my  understanding  of  the  360  report. 

Somewhat  helpful  -  made  some  contribution  to  my  understanding  of  the  360  report. 
Not  very  helpful  -  did  not  contribute  to  my  understanding  of  the  360  report. 

No  help  at  all  -  confused  me  in  attempting  to  understand  the  360  report. 

I  did  not  receive  a  booklet. 

22.  The  source  of  360  assessment  feedback  I  valued  the  most  was  provided  by: 

Superiors. 

Peers. 

Subordinates. 

all  ratings  were  equally  valued. 

not  able  to  compare  (only  had  results  from  one  source). 

23.  The  information  I  received  from  the  360  Assessment  report  was: 

A  great  deal  of  new  information  about  my  leadership. 

Some  new  information  about  my  leadership. 

A  few  interesting  findings,  but  little  new  information  about  my  leadership. 

Nothing  that  I  did  not  already  know  about  my  leadership 

24.  The  information  I  received  from  the  360  Assessment  report  was: 

Extremely  valuable. 

Valuable. 

Of  limited  use. 

Of  no  use. 

25.  To  what  extent  does  the  360  Assessment  Report  motivate  you  to  change  your  behavior? 

Provides  a  great  deal  of  motivation  to  change  my  leadership  behavior. 

Provides  some  motivation  to  change  my  leadership  behavior. 

Provides  no  motivation  to  change  my  leadership  behavior. 

The  360  assessment  did  not  indicate  that  I  should  change  my  leadership  behavior. 

26.  Aside  from  any  administrative  problems,  the  concept  of  360  has: 

no  potential  for  the  Army, 
limited  potential  for  the  Army, 
some  potential  for  the  Army, 
great  potential  for  the  Army. 


Thank  you  for  completing  this  survey. 
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Panama  data  -  Perceptions  of  Multi-rater  Process 

Means,  Standard  deviations,  and  range 


Descriptive  Statistics 


Std. 

N 

Minimum 

Maximum 

Mean 

Deviation 

RFAIR 

54 

1.00 

4.00 

2.7593 

.5807 

RSATIS 

54 

1.00 

4.00 

2.7407 

.5887 

RTRUST 

53 

1.00 

4.00 

3.1321 

.6213 

RRELEV 

54 

1.00 

3.0000 

.7004 

RSUBACC 

54 

1.00 

2.8889 

.6344 

RPACC 

54 

1.00 

2.6296 

.7083 

RSUPACC 

53 

1.00 

2.9811 

.6931 

RSUBAPP 

54 

1.00 

I 

3.2037 

.6835 

peer  appropriate 

54 

1.00 

2.6852 

.7968 

superior  appropriate  source 

52 

1.00 

3.1538 

.6066 

motivated  to  re-examine 

54 

1.00 

|  .9 

2.8333 

.6659 

use  fdbk  to  monitor 

54 

1.00 

2.9259 

.6399 

resources  readily  available 

54 

1.00 

M 

.5828 

can  implement  change 

54 

1.00 

2.9630 

.6132 

working  climate  allows 
change 

54 

1.00 

4.00 

.6443 

adequate  knowledge  of 
process 

54 

2.00 

4.00 

3.1481 

.4517 

fdbk  can  be  used  for 
self-devei 

53 

2.00 

3.1698 

.4697 

understand  methods  for 
data  collection.. 

53 

2.00 

4.00 

3.0566 

.4121 

accurate  assess,  of  leader 
skills 

53 

.00 

3.00 

1.6415 

.6532 

info  1  rcvd  was  new 

54 

.00 

3.00 

1.4815 

.7201 

info  rcvd  was  valuable 

54 

.00 

3.00 

1.7222 

.5961 

360  motivate  to  change 

54 

.00 

3.00 

1.7593 

.6711 

potential  of  360  for  army 

54 

.00 

3.00 

1.0185 

.7646 

Valid  N  (listwise) 

48 
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Correlations 


RFAIR  I  RSATIS 


RFAIR 

Pearson  Correlation 

Sig.  (2-tailed) 

N 

RSATIS 

Pearson  Correlation 

Sig.  (2-tailed) 

N 

RTRUST 

Pearson  Correlation 

Sig.  (2-tailed) 

N 

RRELEV 

Pearson  Correlation 

Sig.  (2-tailed) 

N 

RSUBACC 

Pearson  Correlation 

Sig.  (2-taiied) 

N 

RPACC 

Pearson  Correlation 

Sig.  (2-tailed) 

N 

RSUPACC 

Pearson  Correlation 

Sig.  (2-tailed) 

N 

RSUBAPP 

Pearson  Correlation 

Sig.  (2-taiied) 

N 

peer  appropriate 

Pearson  Correlation 

Sig.  (2-tailed) 

N 

superior  appropriate  source 

Pearson  Correlation 

Sig.  (2-tailed) 

N 

motivated  to  re-examine 

Pearson  Correlation 

Sig.  (2-tailed) 

N 

use  fdbk  to  monitor 

Pearson  Correlation 

Sig.  (2-taiied) 

N 

resources  readily  available 

> 

Pearson  Correlation 

Sig.  (2-taiied) 

N 

can  implement  change 

Pearson  Correlation 

Sig.  (2-tailed) 

N 

working  climate  allows 

Pearson  Correlation 

change 

Sig.  (2-tailed) 

N 

adequate  knowledge  of 

Pearson  Correlation 

process 

Sig.  (2-tailed) 

N 

RTRUST 


.149 

.288 

53 


1.000 


RRELEV  RSUBACC 


.336* 

.013 

54 


Correlations 


RFAIR 

RSATIS 

RTRUST 

RRELEV 

RSUBACC 

fdbk  can  be  used  for 

Pearson  Correlation 

.216 

.154 

.131 

.463** 

.065 

self-devel 

Sig.  (2-taiied) 

.121 

.270 

.355 

.000 

.643 

N 

53 

53 

52 

53 

53 

understand  methods  for 

Pearson  Correlation 

-.017 

-.174 

.050 

.071 

-.194 

data  collection.. 

Sig.  (2-tailed) 

.902 

.214 

.724 

.613 

.164 

N 

53 

53 

52 

53 

accurate  assess,  of  leader 

Pearson  Correlation 

.671** 

JIT* 

.169 

skills 

Sig.  (2-tailed) 

.000 

.231 

3 

N 

53 

53 

52 

1 

53 

info  1  rcvd  was  new 

Pearson  Correlation 

.147 

.211 

.037 

Sig.  (2-tailed) 

.289 

.126 

.792 

N 

54 

54 

54 

54 

info  rcvd  was  valuable 

Pearson  Correlation 

■HjgS 

.205 

.497** 

.017 

Sig.  (2-tailed) 

.141 

.000 

.905 

N 

54 

54 

53 

54 

54 

360  motivate  to  change 

Pearson  Correlation 

HUE  H 

.317* 

.170 

.161 

.113 

Sig.  (2-tailed) 

M 

.020 

.224 

.246 

.415 

N 

54 

54 

53 

54 

54 

potential  of  360  for  army 

Pearson  Correlation 

-.542** 

-.660** 

-.296* 

-.564** 

-.385*" 

Sig.  (2-tailed) 

.000 

.000 

.031 

.000 

.004 

N 

54 

54 

53 

54 

54 
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Correlations 


RPACC 


RFAIR 

Pearson  Correlation 

Sig.  (2-tailed) 

N 

RSATIS 

Pearson  Correlation 

Sig.  (2-tailed) 

N 

RTRUST 

Pearson  Correlation 

Sig.  (2-taiied) 

N 

RRELEV 

Pearson  Correlation 

Sig.  (2-tailed) 

N 

RSUBACC 

Pearson  Correlation 

Sig.  (2-tailed) 

N 

RPACC 

Pearson  Correlation 

Sig.  (2-tailed) 

N 

RSUPACC 

Pearson  Correlation 

Sig.  (2-tailed) 

N 

RSUBAPP 

Pearson  Correlation 

Sig.  (2-tailed) 

N 

peer  appropriate 

Pearson  Correlation 

Sig.  (2-tailed) 

N 

superior  appropriate  source 

Pearson  Correlation 

Sig.  (2-tailed) 

N 

motivated  to  re-examine 

Pearson  Correlation 

Sig.  (2-tailed) 

N 

use  fdbk  to  monitor 

Pearson  Correlation 

Sig.  (2-tailed) 

N 

resources  readily  available 

Pearson  Correlation 

Sig.  (2-tailed) 

> 

N 

can  implement  change 

Pearson  Correlation 

Sig.  (2-tailed) 

N 

working  climate  allows 

Pearson  Correlation 

change 

Sig.  (2-tailed) 

N 

RSUPACC 


peer 

RSUBAPP  appropriate 


superior 

appropriate 

source 


adequate  knowledge  of 
process 


Pearson  Correlation 
Sig.  (2-taiied) 

N 


Correlations 


RPACC 

RSUPACC 

RSUBAPP 

peer 

appropriate 

superior 

appropriate 

source 

fdbk  can  be  used  for 

Pearson  Correlation 

.244 

.081 

.242 

.242 

.152 

self-devel 

Sig.  (2-tailed) 

.078 

.566 

.080 

.081 

.288 

N 

53 

52 

53 

53 

51 

understand  methods  for 

Pearson  Correlation 

.284* 

.146 

.030 

.120 

.144 

data  collection.. 

Sig.  (2-tailed) 

.039 

.303 

.833 

.391 

.312 

N 

53 

52 

53 

accurate  assess,  of  leader 

Pearson  Correlation 

.261 

BC  f»rC mi 

skills 

Sig.  (2-tailed) 

.062 

■ 

1 

1 

N 

■m 

52 

53 

51 

info  1  rcvd  was  new 

Pearson  Correlation 

.171 

.058 

.180 

.171 

-.038 

Sig.  (2-taiied) 

.216 

.680 

.192 

.791 

N 

54 

53 

54 

■ki 

52 

info  rcvd  was  valuable 

Pearson  Correlation 

.333* 

.310* 

■ 

.329* 

.230 

Sig.  (2-tailed) 

.014 

.024 

m 

.015 

.101 

N 

54 

53 

mam 

54 

52 

360  motivate  to  change 

Pearson  Correlation 

.325* 

.158 

.150 

.244 

.095 

Sig.  (2-tailed) 

.017 

.258 

.279 

.076 

.504 

N 

54 

53 

54 

54 

52 

potential  of  360  for  army 

Pearson  Correlation 

-.335* 

-.183 

-.585** 

-.486** 

-.477*" 

Sig.  (2-tailed) 

.013 

.191 

.000 

.000 

.000 

N 

54 

53 

54 

54 

52 
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Correlations 


resources 

can 

motivated  to 

use  fdbk  to 

readily 

implement 

re-examine 

monitor 

available 

change 

RFAIR 

Pearson  Correlation 

Sig.  (2-tailed) 

N 

RSATIS 

Pearson  Correlation 

Sig.  (2-tailed) 

N 

RTRUST 

Pearson  Correlation 

Sig.  (2-tailed) 

N 

RRELEV 

Pearson  Correlation 

Sig.  (2-tailed) 

N 

RSUBACC 

Pearson  Correlation 

Sig.  (2-tailed) 

N 

RPACC 

Pearson  Correlation 

Sig.  (2-tailed) 

N 

RSUPACC 

Pearson  Correlation 

Sig.  (2-tailed) 

N 

RSUBAPP 

Pearson  Correlation 

Sig.  (2-tailed) 

N 

peer  appropriate 

Pearson  Correlation 

Sig.  (2-tailed) 

N 

superior  appropriate  source 

Pearson  Correlation 

Sig.  (2-tailed) 

N 

motivated  to  re-examine 

Pearson  Correlation 

Sig.  (2-tailed) 

N 

use  fdbk  to  monitor 

Pearson  Correlation 

Sig.  (2-tailed) 

N 

resources  readily  available 

> 

Pearson  Correlation 

Sig.  (2-tailed) 

N 

can  implement  change 

Pearson  Correlation 

Sig.  (2-tailed) 

N 

working  climate  allows 
change 

Pearson  Correlation 

Sig.  (2-tailed) 

N 

adequate  knowledge  of 
process 

Pearson  Correlation 

Sig.  (2-tailed) 

N 

Correlations 


motivated  to 
re-examine 

use  fdbk  to 
monitor 

resources 

readily 

available 

fdbk  can  be  used  for 

Pearson  Correlation 

.342* 

.163 

.059 

■ 

self-devel 

Sig.  (2-tailed) 

.012 

.243 

.672 

1 

N 

53 

53 

53 

I 

understand  methods  for 

Pearson  Correlation 

.035 

-.128 

.005 

-.142 

data  collection.. 

Sig.  (2-tailed) 

.801 

.363 

.974 

.311 

N 

53 

53 

53 

53 

accurate  assess,  of  leader 

Pearson  Correlation 

.184 

.345* 

.250 

.394*' 

skills 

Sig.  (2-tailed) 

.188 

.011 

.071 

.004 

N 

53 

53 

53 

53 

info  1  rcvd  was  new 

Pearson  Correlation 

.446** 

.284* 

.180 

.212 

Sig.  (2-tailed) 

.001 

.038 

.193 

.124 

N 

54 

54 

54 

info  rcvd  was  valuable 

Pearson  Correlation 

S 

ill 

Sig.  (2-tailed) 

Wwm 

1  1 

N 

54 

360  motivate  to  change 
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Pearson  Correlation 
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Pearson  Correlation 
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Sig.  (2-tailed) 

N 

superior  appropriate  source 

Pearson  Correlation 
Sig.  (2-tailed) 
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methods  for 
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-.118 
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54 
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.131 
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N 
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54 

53 
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53 
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54 

**.  Correlation  is  significant  at  the  0.01  level  (2-tailed). 
*.  Correlation  is  significant  at  the  0.05  level  (2-tailed). 
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